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Abstract 

To quantify the randomness of Markov trajectories with fixed initial and final states, Ekroot and Cover proposed 
a closed-form expression for the entropy of trajectories of an irreducible finite state Markov chain. Numerous 
applications, including the study of random walks on graphs, require the computation of the entropy of Markov 
CN ! trajectories conditioned on a set of intermediate states. However, the expression of Ekroot and Cover does not 

allow for computing this quantity. In this paper, we propose a method to compute the entropy of conditional 
Markov trajectories through a transformation of the original Markov chain into a Markov chain that exhibits the 
desired conditional distribution of trajectories. Moreover, we express the entropy of Markov trajectories — a global 
quantity — as a linear combination of local entropies associated with the Markov chain states. 
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Index Terms 
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I. INTRODUCTION 

c/5 ■ UANTIFYING the randomness of Markov trajectories has applications in graph theory [fTOl and in statistical 

\9 physics [71, as w^ell as in the study of random w^alks on graphs [IJ, [8|. The need to quantify the randomness 
of Markov trajectories first arose w^hen Lloyd and Pagels [7 1 defined a measure of complexity for the macroscopic 
■ states of physical systems. They examine some intuitive properties that a measure of complexity should have and 
_^ ! propose a universal measure called depth. They suggest that the depth of a state should depend on the complexity 
CO " of the process by w^hich that state arose, and prove that it must be proportional to the Shannon entropy of the 
set of trajectories leading to that state. Subsequently, Ekroot and Cover [4J studied the computational aspect of 
the depth measure. In order to quantify the number of bits of randomness in a Markov trajectory, they propose a 
closed-form expression for the entropy of trajectories of an irreducible finite state Markov chain. Their expression 
^ does not allows, how^ever, for computing the entropy of Markov trajectories conditioned on the realisation of a set 
^ of intermediate states. Computing the conditional entropy of Markov trajectories turns out to be very challenging 
yet useful in numerous domains, including the study of mobility predictability and its dependence on location side 
k3j information. 

;h Consider a scenario w^here w^e are interested in quantifying the predictability of route-choice behaviour We 
can model the mobility of a traveller as a w^eighted random w^alk on a graph w^hose vertices represent locations 
and edges represent possible transitions BSJ. We can therefore model a route as a sample path or trajectory in a 
Markov chain. If we suppose that we know where the traveller starts and ends her/his route, the randomness of 
the route she/he would follow is represented by the distribution of trajectories between the source and destination 
vertices. Consequently, the predictability of her/his route is captured by the entropy of Markov trajectories between 
these two states. Now, if we obtain side information stating that the traveller went (or has to go) through a set 
of intermediate vertices, quantifying the evolution of her/his route predictability requires the computation of the 
trajectory entropy conditioned on the set of known intermediate states. The conditional entropy is also a way to 
quantify the informational value of the intermediate states revealed. For example, if the entropy conditioned on the 
set of known intermediate states is zero, then this set reveals the whole trajectory of the traveller 

In our work, we propose a method to compute the entropy of Markov trajectories conditioned on a set of 
intermediate states. The method is based on a transformation of the original Markov chain so that the transformed 
Markov chain exhibits the desired conditional distribution of trajectories. We also derive an expression that enables 
us to compute the entropy of Markov trajectories, under conditions weaker than those assumed in El. Moreover, 
this expression links the entropy of Markov trajectories to the local entropies at the Markov chain states. 



The authors are with the School of IC, EPFL, Lausanne CH-1015, Switzerland. 
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II. The MODEL 

Let {Xi} be a finite state irreducible and aperiodic Markov chain (MC) with transition probabihty matrix P 
whose elements are the transition probabilities 

This MC admits a stationary distribution 11, which is the unique solution of 11 = IIP. The entropy rate H{X) is 
a measure of the average entropy growth of a sequence generated by the process {Xi} and is defined as 

H{X)^ lim -i/(Xi,X2,...,X,). 

71— ^'OO Jl 

For the particular case of an irreducible and aperiodic MC, the limit above is equal to [2, p. 77] 

H{x)^Y.^m{n.), 

i 

where P^. denotes the i^^ row of P and where H{Pi.) = — Pij log{Pij) is the local entropy of state i Note that, 
throughout this paper, we use MCp as a shorthand for the Markov chain whose transition probability matrix is P. 



A. The Entropy of Markov Trajectories 

We follow the setting of f4J closely. We define a random trajectory Tgd of a MC as a path with initial state s, 
final state d, and no intermediate state d, i.e., the trajectory is terminated as soon as it reaches state d. Using the 
Markov property, we express the probability of a particular trajectory tgd = sx2-.-Xkd given that Xi = 5 is 

Pifsd) ~ -^8X2-^x2X3 • • • -^Xkd- 

Let Tsd be the set of all trajectories that start at state s and end as soon as they reach state d. As the MC defined 
by the matrix P is finite and irreducible, we have 

P^^sd) = 1 for all s,d. 

So the discrete random variable Tgd has as support the set Tsd, with the probability mass function p{tsd)- 
Subsequently, we use ^(^5^^) as a shorthand for p{Tsd = ^5^)- We can now express the entropy of the random 
trajectory Tgd as 

Hsd = H{Tsd)^- Pitsd)logp{tsd)^ 

tsdETsd 

We define the matrix of trajectory entropies H where Hij = H{Tij). Ekroot and Cover (U provide a general 
closed-form expression for the matrix H of an irreducible, aperiodic and finite state MC. 
The entropy Hgd\u of a trajectory from 5 to d given that it goes through u is defined by 

H,aiu = H{%a\Tsd^Vd) = - E P{isd\Tsd^Vd)^ogp{tsd\Tsd^Vd). (D 

tsd^T^d 

where 7^^ is the set of all trajectories in Tsd with an intermediate state u 

T^d = {tsd ^Tsd'tsd^ s...u...d}. 

The major challenge is to compute efficiently the entropy Hgd\u' Even the costly approach of computing all the 
terms of the sum ([T]) is not always possible because the set T^ has an infinite number of members in the case 
where, after removing state d, the transition graph of the MC is not a DAG. It is important to emphasize that the 
entropy H^^^^ is not the entropy of the random variable Tgd given another random variable — a quantity which is 
easy to compute — but the entropy of Tgd conditioned on the realization of a dependent random variable. 

In Figure [TJ we show an example of a finite state irreducible and aperiodic MC. Note that the presence of 
cycles implies that the set of trajectories between some pair of states might have infinite cardinality (|7i4| = 00 for 
example). Therefore, in addition to being complex, the naive approach of enumerating all trajectories is not always 
possible. 
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Fig. 1. An irreducible, 5-states, Markov chain annotated with the transition probabilities. 
Using the results of [4], we obtain the matrix of trajectory entropies 
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The zero elements of the matrix H correspond to deterministic trajectories such as r25, which is equal to the path 
25 with probability 1 since no other path allows a walk to go from 2 to 5. The entropy of the random trajectory 
Tis is 1.56 bits. Now imagine that we have an additional piece of information stating that the trajectory T15 goes 
through state 4. Intuitively, we would be tempted to argue that the entropy i?i5|4 of the trajectory T15 conditioned 
on going through state 4 is equal to i7i4 + 7^45, but this additivity property does not hold. Indeed, the conditional 
entropy i?i5|4 is zero because the trajectory T15, conditioned on the intermediate state 4, can only be equal to the 
path 1345, whereas i^M = 3.18 bits, hence i^M + H^^ = 3. 18 + = 3.18 7^ H^^^ bits. 

In the next section, we study the entropy of Markov trajectories conditioned on multiple intermediate states and 
derive a general expression for this entropy. 



III. The Entropy of Conditional Markov Trajectories 
Let asud denote the probability that the random trajectory T^a goes through the state u at least once: 

This is also equal to the probability that a walk reaches the state u before the state d, given that it started at 5. In 
order to compute agud^ the technique from (6\, (9] is to make the states u and d absorbing (a state i is absorbing 
if and only if Pa = 1) and compute the probability to be absorbed by state u given that the trajectory has started 
at state s. 

Our first step towards computing Hg^^^^ is to express it as a function of quantities that are much simpler to 
compute. The idea is to relate the entropy of a trajectory conditioned on a given state to its entropy conditioned 
on not going through that state. Therefore, we define the entropy iJ^^ii^i of a trajectory from 5 to d given that it 
does not go through u to be 

Hsd\u = H(Tsd\Tsd ^ T^d)- 

Using the chain rule for entropy, we can derive the following equation which relates Hgfi\u to H^d^ ^sud- 

Hsd = oisudHsd\u + (1 - (^sud)Hsd\u + h{asud) (2) 

for all u, where h{asud) is the entropy of a Bernoulli random variable with success probability asud- 
Proof: First, we define the indicator variable / by 

1 otherwise. 
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Using the chain rule for entropy, we express the joint entropy H(Tsd^ I) in two different ways, 

H{TsdJ) = H{I) + H{Tsd\I) = H{Tsd) + H{I\Tsd) = H{Tsd)^ 
because / is a deterministic function of Tsd- So the entropy of the random trajectory T^d can be expressed as 

H{Tsd) = H{I)^H{Tsd\I) 

= H{I) + H{Tsd\I = l)p{I = 1) + H{Tsd\I = 0)p(/ = 0) 
= + H{TA ^ VMTsd ^ V,) + H{Tsd\Tsd i VMTsd ^ V,). 

Since asud = ^(r^d G 7^^) = p(/ = 1), we obtain 

H{Tsd) = asudH{Tsd\Tsd ^ Vd) + (1 " i Vd) + /^(c^.ud)- 

■ 

As we know from flU, O, jQl how to compute Hgd and astici, if we are able to compute H^^^^^, we can use ([2]) 
to find i?5(i|w However, generalizing (|2]) to trajectories conditioned on passing through multiple intermediate states 
turns out to be difficult, hence we propose an approach that circumvents this problem. As we will see, the difficulty 
of our approach also boils down to computing the entropy of a trajectory conditioned on not going through a given 
state. 

First, we define 7^^, the set of all trajectories in Tsd that exhibit the sequence of intermediate states u = 
uiU2 • • - uu i.e. 

T^d = {^sd e Tsd - tsd = S . . . Ui . . . U2 . . . Ui . . . d}. 

For an arbitrary sequence of states u = uiU2 • • - Uu satisfying p{Tsd ^ T^ > 0, we prove the following lemma. 



Lemma 1: 

l-l 

H{Tsd\Tsd e T^) = Yl ^UkUk+^\d + Huid^ (3) 

where uq = s. 

Proof: First, given Tsd ^ T^, the random trajectory Tsd can be expressed as a sequence of random sub- 
trajectories {Tsu,,Tu,u2^ ' ' ' ^Tu,_,unTu,d)' Therefore, the conditional entropy H{Tsd\Tsd ^ T^), which we denote 
by can be written as a joint sub-trajectory entropy 

-^sd\ui...ui ~ H (Tsui 1 Tu-^^U2 1 • • • iTu^(j\Tsd ^ 'Tsd)' 

Applying the chain rule for entropy, we obtain successively 

Hsd\ui...ui ~ ^(2~swi 5 2~uiU2 5 • • • 5 2^uz(i|2~!s(i ^ T^ci) 

= H{Tsui\Tsd ^ 7^) + H{Tu^u2\Tsui'iTsd ^ 7^) + . . . + H{Tuid\Tsui, • • • ,Tui_^unTsd ^ T^). 

The Markovian nature of the process generating the trajectory Tsd implies that each of the sub-trajectories Tu^^k^^ 
is independent of the preceding ones, given its starting point u^. Since the sequence su = 51^1^x2 ■ ■ - Ui defines the 
starting point of each sub-trajectory, we can therefore write that 

H {Tu,^Uk+i\Tsui 1 • • • iTuk-iUk'^Tsd ^ Tsd) ~ {TukUk+i\Tsd ^ Tld)' W 

Using dll), the expression for the conditional entropy becomes 

Hsd\ui...ui = H{Tsu^Tsd ^ T^) + H{Tu^u2\Tsd ^ T^) + • • • + H{Tuid\Tsd ^ T^)- 

Note that for each trajectory Tuf^Uk+i^ the only restriction imposed by the event {Tsd ^ T^} is that the final state 
d cannot be an intermediate state of any of the first / trajectories Tsm^Tu^u2i • • • ^Tui_^ui- As a result, 

l-l 

Hsd\ui...ui = H{Tsu^\Tsu^ ^ TfuJ + H {Tu^u^\Tu^u^ ^ T^^i^s) + • • • + H{Tuid) = ^ ^UkUk+ild + Huid^ 

k=0 
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where uq = s ■ 
Now, if we are able to compute i/^^^^^^jj, we can use ([3]) to derive H{Tsd\Tsd ^ 7^^)- The following lemma 
shows how the conditional entropy H^^^^^^^^ can be obtained by a simple modification of the MC. 
We consider a MC whose transition probability matrix is P, and s, u and d three distinct states such that asud = 
p{Tsd ^ T^d) ^ ^- ^ transition matrix of the same MC but where both states u and d are made absorbing, 

and whose entries are thus 

✓ 

if z = ix, d and i ^ j, 

1 if i = u^d and i = j, (5) 



P 



P^j otherwise. 



Next, we define a second matrix P\ obtained by a transformation of the matrix P 



Pij if «m(i 7^ 1, 



P^j Otherwise 



Lemma 2: (i) The matrix P' is stochastic and (ii) If T^^ is a random trajectory defined on the MC whose 
transition probability matrix is P' then 

H{T,a\Tsd i Vd) = H{TU). 

Proof: 

(i) The matrix P is the transition probability matrix of a MC where the states u and d are absorbing. We can 
therefore introduce the vectors of absorption probability = (^iw, cl2u^ • • • ? CLnu) and = {aid^ a2d^ • • • , cind) 
where a^^^ and a^^ are, respectively, the probability of being absorbed by u and d, given that the trajectory starts at 
i. These vectors are eigenvectors of P associated with the unit eigenvalue [9, p. 227] 

Pau = au Pad = a^. (7) 

Moreover as MCp has only two absorbing states u and d, for all i, a^^^ = 1 — a^^. Recall that for all i, aiud = ciiu 
hence (|6]) can be written as 



P'. = 



P^j otherwise. 



Note that all transitions leading to state u in MCp will have zero probability in MCp'. In fact, consider a state i such 
that P^^i > and aid > 0. In the new matrix P^ the probability of transition from z to will be P/^ = CLudPiu/cud 
, which is zero because a^d = 0. Proving that P' is stochastic is now straightforward: First, the entries of P' 
are positive; Second, they are properly normalized and sum up to one. Indeed, if we consider a state i such that 
did = 0, we have that P^- = Pij = 1 whereas if aid ^ 0, we have that 

j j ^id ^id j ^id ^id 

because of (O. 

(ii) Let p and p' be the probability measures defined, respectively, for MCp and MCp' on the same sample 
space Tsd' Any trajectory from the set Tsd has the form tsd = sx2---Xkd. 

^^^sd^Vd^ 

p\tsd) = (8) 

since we have constructed MCp' such that all transitions leading to state u have zero probability. 

If tsd i T^d^ we have 

f(i ,\ — p' p' p' — p ^^3C^ p _«;dd_p p p , {q\ 

P \^sd) — ^8X2-^X2X3 ' ' ' ^Xkd — ^SX2 ^X2X3 ' ' ' ^Xkd — ^8X2-^X2X3 ' ' ' ^Xkdi 

^sd ^X2d ^Xkd ^sd 
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but add = 1 as the probability to be absorbed by state d, given that we have started at this same state, is 1. Moreover, 
we know from (|5]) that Pij = Pij, for all i ^ u^d. As we have supposed that the trajectory tgd does not admit 
either or d as intermediate states, Psx2Px2Xs • • • Px^d = Psx^Px^xs • • • Px^d- Rewriting Q yields 

P{tsd) Psx2Px2X3 ' ' ' Pxkd Z \ P{tsd\Tsd ^ 7^^)- (10) 

(^sd ^ ~ CLsu ^~P\-'-sd^ I sd) 

Combining ([8]) and ([TOl) , we have therefore proven, for all tsd ^ Tsd^ that 

p'{Ud)^p{tsd\TsdiVk)- (11) 

Consequently, if the random variable T^^ describes the trajectory between s and d in MCp^, ([TT1) implies that 

H{nd\Tsd^Vd)-H{r,d)- 

■ 

For the particular case where 5 = d, we still can use Lemma [2] to express the conditional entropy Hgg^^: We 
modify the MC by removing the incoming transitions of s and creating a new state that will inherit them. The 
conditional entropy i^^si^^ in the original MC is equal to Hgg,\^ in the modified one and, since s ^ s\ we can use 
Lemma [2] to express it. 

Building on Lemma [H and Lemma O we can now state the main result of this paper: a general expression for 
the entropy of Markov trajectories conditioned on multiple intermediate states. 

Theorem 1: Let P be the transition probability matrix of a finite Markov chain and sud = sui . . .uid a sequence 
of states such that p{Tsd ^ T^) > 0. Then, we have the following equality 

i-i 

H{Tsd\Tsd ^T:'d)-Y. H{K,u,J + H{T^,d), (12) 

k=0 

where uq = s, and T^^^^^^ is a random trajectory defined on the Markov chain whose transition probability matrix 
Pj^ is defined as follows 

if z = Uk^i, d and i ^ j, 

1 if z = Uk^i, d and i = 7, 
(PM-- = < (13) 

^ fij if i 7^ ^fc+i, 0? and otidu^^^ < 1- 

Proof: The matrix is obtained from P using ([T3l) . which is equivalent to applying successively (|5]) and (|6]) 
where the starting, intermediate and ending states are, respectively, u^, d and u^^i. Therefore, using Lemma |2l we 
have 

for all < A: </ — 1. Consequently, we can write that 

i-i i-i 

^ HiT'^^Uk+i) + H{Tu,d) = ^ H(Tu^Uk+i\PukUk+i ^ TukUk+i) + H(Tu^d) 

k=0 k=0 

where uq = s. Using (|3]), we finally obtain 

i-i 

■ 

Now that we have derived a general expression for the entropy of Markov trajectories conditioned on multiple 
states, we introduce, in the next section, a method that allows us to compute this expression. 
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IV. Entropy Computation 

The closed-form expression for the entropy of Markov trajectories proposed by Ekroot and Cover [4] is valid 
only if the Markov chain studied is irreducible. However, the Markov chain MCp' obtained from MCp after the 
transformations ^ and (|6]) is not necessarily irreducible: all transitions leading to state u have zero probability, 
which implies that possibly many states do not admit any path leading to d. Therefore, we need an expression 
for the entropy of Markov trajectories that is valid under milder conditions. In order to identify these conditions, 
we study the properties of MCp'. Let S be the set of all states in MCp' and let Si and 52 be two subsets that 
partition S in the following manner 



5i = {z G 5 : a^rf > 0} ^2 = {i G 5 : aid = 



0}. 



The set Si is closed as no one-step transition is possible from any state in Si to any state in 52. In fact, if i G 5i 
and j G 52, © yields that P/^ = Pijajd/aid = 0. Clearly, all trajectories leading to state d are composed of states 
belonging to Si. Now, we propose a closed-form expression for the entropy of Markov trajectories that is valid 
under the weaker condition that the destination state d can be reached from any other state of the MC. Moreover, 
we prove that the trajectory entropy can be expressed as a weighted sum of local entropies. We also provide an 
intuitive interpretation of the weights. 

Lemma 3: Let P be the transition probability matrix of a finite state MC such that there exists a path with 
positive probability from any state to a given state d. Let Qd be a sub-matrix of P obtained by removing the d^^ 
row and column of P. 



P 



V Pdi 



dd 



For any state s ^ d, the trajectory entropy Hsd can be expressed as 

Hsd = E((^ - Qdr^)skH{Pk.)^ (14) 

k^d 

where H{Pk.) is the local entropy of state k. 

Proof: First, observe that the matrix Qd is a sub-matrix of P corresponding to all states except state d and 
that we use Qd to derive the entropy of all trajectories ending at d. Applying the chain rule for entropy, we express 
the entropy of a trajectory as the entropy of the first step plus the conditional entropy of the rest of the trajectory 
given this first step 

Hsd = H{Ps.) + E PskHkd- 

k^d 

We expand this equality further by recursively expanding the entropy H^d as follows 

k^d \ k'^d 

= H{Ps.) + PskH{Pk.) + Y.PskY. Pkk'Hk'd 

kjtd kytd k'f^d 

= H{Ps.) + ^ PskH{Pk.) + Y.PskY. Pkk' [H{Pk'.) + Pk'k" \H{Pk".) + •••)) 
k^d k^d k'y^d V fc'Vrf V // 

= H{Ps.) + Y ( E(Q/).fc I H{Pk.) 

kjtd \i=l ) 

= E ( E(Q^'H ^(^^■^' ^^^^ 

ki^d \i=0 / 

with = I. 
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Observe that the matrix describes the Markov chain as long as it does not reach state d. Moreover, the matrix 
Qd has a finite number of states and there is a path with positive probabihty from each state to state d. As a 
consequence, the Markov process will enter state d with probability 1, i.e., lim^^oo Qd^ = O (zero matrix). In 
addition, since 

(/ - Qd){i + Qd + Qd^ + --- + Qd"-^) = / - Q/, 

we can easily verify that 

oo 

^Q/ = (/-Q^)-i. (16) 

Replacing ([T6l) in ([15]), we have 

Hsd-Y.^{i -Qdr^)skH{Pk.). 

k^d 

■ 

We have shown that the entropy of a family of trajectories can be expressed as a weighted sum of the states' 
local entropies. The weights are given by the matrix {I — Qd)~^. In the Markovian literature, the matrix {I — Qd)~^ 
is referred to as the fundamental matrix flS], [|9]. In fact, the {skf^ element of the fundamental matrix (defined 
with respect to the destination state d) can be seen as the expected number of visits to the state k before hitting 
the state d, given that we started at state s. As a result, the entropy of the random trajectory Tsd is the sum over 
the chain states of the expected number of visits to each state multiplied by its local entropy. This is a remarkable 
observation since it links a global quantity, which is the trajectory entropy, to the local entropy at each state. 

Recall that in the example shown in Figure [H we found that the entropy of the trajectory T15 is equal to 1.56 
bits. We can retrieve this result by computing the fundamental matrix with respect to state 5. The {ijY^ element 
of this matrix is equal to the expected number of visits to state j before hitting state 5, given that we started at 
state i. Multiplying the first row of the fundamental matrix (1,0.625,0.75,0.375) by the column vector of local 
entropies (0.81, 0, 1, 0) yields Hi^ = 1 x 0.81 + 0.75 x 1 = 1.56 bits. 



A. Algorithm 

The following algorithm defines the set of steps to compute the entropy of Markov trajectories conditioned on 
a set of intermediate states: 



Input: Matrix of transition probability P, source state s, destination state d, sequence of intermediate states 




U — Ui . . .Ui 


Output: H,a\u,...m 


1 


Uq ^ S 


2 


for A: = to / - 1 do 


3 


Compute from P using ([T3]) 


4 


Compute H{T[j^^^^ J from P^ using Lemma [3] 


5 


Hu,u.,Ad^H{TH^^J {LemmaEl} 


6 


end for 


7 


Compute Huid from P using Lemma |3] 


8 


Hsd\u,...u, = Ei=o^«,«,^,|d + ^«<d {Lemma 


9 


return H^d\u,...ui 



The worst-case running time for the algorithm is 0{lN^) where N is the number of states of MCp, and / 
the length of the sequence of intermediate states u. This complexity is dominated by the cost of computing the 
inverse of the matrix (/ — Q^), which is needed to compute the entropy Hgd in ([T4l) . However, since we need only 
the s^^ row of the matrix (/ — Q^) to compute the trajectory entropy Hgd, we can solve a system of — potentially 
sparse — linear equations. Moreover, many iterative methods [5, p. 508] take advantage of the structure of the matrix 
representing the system of linear equations in order to solve them efficiently. 

Coming back to the example shown in Figure [D we use the algorithm above to compute the conditional entropy 
^15|3 = 1 bit. We leave no ambiguity about the trajectory Tis when we condition on both states 3 and 2 and find 

that i?i5|3,2 = ^13|5 + ^32|5 + ^25 = bitS. 
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V. Conclusion 

In this paper, we address the problem of computing the entropy of conditional Markov trajectories. We propose 
a method based on a transformation of the original Markov chain into a Markov chain that yields the desired 
conditional entropy. We also derive an expression that allows us to compute the entropy of Markov trajectories, 
under conditions weaker than those assumed in [4]. Furthermore, this expression links the entropy of Markov 
trajectories — a global quantity — to the local entropy of states. 

These results have applications in various fields including mobility privacy of the users of online services. In 
fact, using our framework, we are able to quantify the predictability of a user's mobility and its evolution with 
locations updates: We represent a location as a state of a Markov chain. A sequence of visited locations is therefore 
a Markovian trajectory, and location-updates amount to conditioning this trajectory on a set of intermediate states. 
In this setting, we can quantify the evolution of the user's mobility predictability as she/he discloses some of 
the locations she/he visited by computing the entropy of conditional Markov trajectories. Consequently, users are 
empowered with an objective technique to protect their privacy: they are able to anticipate the evolution of their 
mobility predictability as they reveal a subset of the locations they visited. 
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